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Output consensus of nonlinear multi-agent systems with 
unknown control directions 


Yutao Tang * 


Abstract: In this paper, we consider an output consensus problem for a general class of nonlinear multi- 
agent systems without a prior knowledge of the agents’ control directions. Two distributed Nussbaum- 
type control laws are proposed to solve the leaderless and leader-following adaptive consensus for hetero¬ 
geneous multiple agents. Examples and simulations are given to verify their effectiveness. 
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1 Introduction 


Multi-agent system has been a hot topic in the last decades due to its numerous applications, such as 
cooperative control of unmanned aerial vehicles, communication among sensor networks, and formation 




of mobile robots( 16|,|l8|). As one of the most important problems, consensus with or without leaders 
has been extensively studied. For example, various distributed protocols were proposed and analyzed in 
[hf for both leader-following and leaderless cases. In Q, the authors proposed a distributed observer- 
based control law using local information to track an integrator-type leader. Later, this work has been 
extended to multi-agent systems with a general linear dynamics (jg, 14]) under switching topologies. Other 
extensions including consensus under time-delay communications or with an unknown-input driven leader 
have been studied in [s|, [o. 211. 


Output consensus problem of nonlinear agents have also been studied by many authors. As an extension 
for single integrators .the output synchronization of a group of input-output passive nonlinear systems 
were investigated in [3| by adding proper couplings between them. Similar results were obtained in Q, 
where networks of cyclic feedback biochemical oscillators were analyzed by dissipativity theory to achieve 
synchronization. In 23], nonlinear multi-agent systems in output feedback form with unity relative 
degree was studied to achieve leader-follower consensus. However, most of existing results were obtained 
by assuming the control direction matrix or at least the sign for single-input single-output case was 
known. 

In practice, a control direction may not always be known a priori in many applications. For example, 
under some steering conditions like a course-changing operation, the control direction of a ship may be 


unknown [4j]. Even if it is known at first, the control direction of a plant may be changed by some 
structural damage jjjJ. To tackle this problem, the Nussbaum-type function, originally proposed in Q], 
has been extensively used to solve such a problem. 

For a single system with only one Nussbaum-type function used ([3])> the stability of the closed-loop 
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system can be analyzed relatively easily. For a group of systems that are (physically) interconnected and 
each system involves an unknown control direction, the control design and stability analysis become more 
difficult since the controller of each subsystem might need one Nussbaum-type function. A decentralized 
adaptive control problem was first tackled in [24j by respectively constructing a single Lyapunov function 
candidate for each subsystem and employing one Nussbaum-type function for each corresponding subsys¬ 
tem. Recently, to achieve the consensus of integrator-type agents, a special type of Nussbaum functions 
has been constructed in [3|. However, these results relied on the assumption that all unknown control 
directions are with the same sign. In fact, the results on consensus for agents with unknown heterogonous 
high-frequency gain signs are very few with only one exception 0], where a Nussbaum-type adaptive 
controller was designed for each single-integrator agent such that consensus of the multi-agent network 
can be achieved. Nevertheless, the solvability of consensus among more general linear and nonlinear 
agents with unknown control directions is still unclear. 

To answer this question, we mainly emphasize on a class of nonlinear heterogeneous agents having a 
passivity-like property with unknown control directions. By constructing a Nussbaum-type protocol, we 
can achieve leaderless output consensus under a mild connectivity condition of the communication graph 
among those agents. With some minor modifications, this protocol is also able to drive all agents to some 
desired value, such as the equilibrium. In this way, our main contributions are at least two-fold: 


• We consider a group of heterogeneous agents with unknown control directions. Comparing with 
the results in [2[, this control protocol can allow the cases when those control directions have 
nonidentical signs. These conclusions are consistent with existing coordination results in [1, 


m- 


• We consider a more general class of agent’s systems with unknown control directions, which strictly 
cover those heterogeneous single integrators considered in EL 0- Even for those single integrators, 
these results still hold for a class of directed graphs, while the conclusions in Q are obtained only 
for undirected graphs. 


The rest of this paper is organized as follows. Some preliminaries and problem formulation are given 
in Section 2 and 3. Main results are presented in Section 4, where two types of adaptive control laws are 
proposed for both leaderless and leader-following cases. Finally, simulations and our concluding remarks 
are presented at the end. 

Notations: Let R” be the n-dimensional Euclidean space, and R nxm be the set of n x to real matrices. 
For a vector x , ||:r|| denotes its Euclidian norm. diag{&i,..., b n } denotes an n x n diagonal matrix with 
diagonal elements bi (i = 1,..., n); col(cii,..., a n ) = [aj,..., a^] T for any column vectors a* (i = 1,..., n). 


2 Preliminaries 

Before the main results, we introduce some preliminaries on graph theory and nonlinear systems. 

A directed graph (or digraph) Q = (TV, £), where TV" = {1,..., n} is the set of nodes and £ is the set of 
edges ([0). (i, j) denotes an edge leaving from node i and entering node j. A directed path in graph Q 
is an alternating sequence i\e\ • -ek-iik of nodes ii and edges e m = ( i m , i m + 1 ) € £ for l = 1,2,.. k. 
If there exists a directed path from node i to node j then node i is said to be reachable from node j. 
The neighbor set of agent i is defined as TV) = {j : (j, i) £ £} for i = 1,..., n. A weighted adjacency 
matrix of a digraph Q is denoted by A = [a,y] € R" xn , where an = 0 and a,; 7 - >0 (a l7 >0 if and only 
if there is an edge from agent j to agent i). The Laplacian L = [Uj] € R” x " of digraph Q is defined 
as la = a ij an d hj = 7^ *)■ Define the in-degree and out-degree of node i as d = J2j a ij 
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and d° ut = Y2j a ji , respectively. Node i is balanced if and only if its in-degree equals its out-degree, the 
digraph Q is weight-balanced if and only if all of its nodes are balanced. Note that LI = 0, a digraph 
is weight-balanced if and only if l l L = 0. For a digraph, its underlying graph is the graph obtained by 
replacing all the directed edges with undirected edges. If between every pair of distinct vertices, there 
is a directed path, this digraph is said to be strongly connected. A digraph is weakly connected if its 
underlying graph is connected. As stated in (1 3^ , let Q be a digraph with Laplacian matrix L , then 
L = L + L t is a valid Laplacian matrix for its mirror graph Q if and only if Q is balanced. A digraph is 
said to be undirected if a l3 = aji (i,j = 1,.. .,n). Obviously, any undirected graph is balanced. 

A dynamic system 


x = f(x,u), y = h(x), x£M n ,u,y£M p (1) 

is said to be passive (Q), if there exists a continuously differentiable function V(x) >0 such that 

V < — W{x) + u T y 

for some positive semidefinite function W(x). V(x) is often called its storage function. This system is 
said to be strictly passive if W (x) is positive definite. Passivity, due to its explicit physical meaning and 
simplicity to manipulate, has been extensively by many authors both for a single plant and multi-agent 
systems (e.g., [1, |l9|). For simplicity, we only consider in this paper the single-input single-output case, 
i.e., p= 1. 

It has been proved that the passivity of a dynamic system is much related to its high-frequency gain 


( 11]), which represents the motion direction of the system in any control strategy. In most of existing 


literatures, this control direction is assumed to be known a prior, or the high-frequency-gain sign is 
positive, e. g.,(l, 19, 2cJ. As having been mentioned, the control direction of a plant might be unknown or 


change under sudden structural damages. Thus, we consider a general class of nonlinear passive systems 
with unknown control directions, that is, for system Q. there exists a continuously differentiable function 
V(x) >0 such that 


V(x) < —W(x) + buy 


where b is an unknown non-zero constant and W(x) some positive semidefinite function. 

It can be found that if the constant b or its sign is known a prior, then let u = sign (b)u, this system is 
passive with input u and output by. However, if b or its sign is unknown, the conventional passivity-based 
controller is no longer applicable. 


3 Problem Formulation 

Consider a multi-agent system consisting of N nonlinear agents described by 

Xi = fi(xi, ui}, yi = hi(xi ), i = l,...,N (2) 

where Xj £ R ni ,iq £ R ,yi £ R are its state, input, and output of agent i. ft{-) and hi{-) are locally 
Lipschitz. Assume that, after a possible inner-loop control, these agents are all passive but with unknown 
control directions, i.e., for each *, there exist a continuously differentiable function Vi(xi) > 0 and a 
positive semidefinite function Wj(xi) such that 

Vi(xi) < -Wi(xi) + biUiyi (3) 
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where bi is an unknown nonzero constant. 

Associated with this multi-agent system, a digraph Q can be defined with the nodes Af = {1,..., TV} to 
describe the communication topology. If the control Ui can get access to the output information of agent 
j, there is an weighted edge (j, i) in the graph Q, i. e., a,; 7 > 0. 

Our control objective is to design it, for each agent in graph Q, such that output consensus of this 
multi-agent system composed of m can be achieved, i. e., fji — yj —> 0 as t —> oo for any i, j = 1,..., TV 
while the overall system maintains bounded. 


Remark 1 In most of existing works considering the coordination of linear or nonlinear multi-agent 


systems , lA . \2(\ . \2&] . the high-frequency-gain sign of each agent is assumed to be known in prior. But 


in our formulation, the prior knowledge of each agent ’s high-frequency-gain sign is no longer necessary. 
Compared with the results in where all the high-frequency gains should have an identical sign, agents 
considered here may have different and unknown control directions. 


Remark 2 The class of systems considered here can not only strictly cover the systems considered in 
07, but also include a rather general class of linear or nonlinear passive systems ^l^j) with unknown 
control directions. While passivity has been employed as a powerful tool for group coordination &lw, 
this formulation will enlarge its applications in multi-agent systems. 


4 Main Results 


In this section, we will first present a Nussbaum-type protocol to achieve leaderless output consensus for 
those heterogeneous agents, and then provide an extension to the leader-following cases. 

Theorem 1 Consider the multi-agent system consisting of TV agents given by ©, there exists a dis¬ 
tributed adaptive controller of the form 

Ui = -Af{ki)£i, ki = yi£,i (4) 

where £$ = Yl^Li a ij(Vi ~ Uj) an d Af{kf) = k 2 sin(fcj), such that the output consensus of this multi-agent 
system is achieved when the communication graph is undirected and strongly connected. 

Proof: The proof will be spit into two steps. 

Step 1: We first prove the boundedness of Xi, Ui , and ki. From the smoothness of related functions, 
the solution of this closed-loop system will be well-defined on its maximal interval [0, tf). We claim that 
tf = +oo. In the following, we will prove it by seeking a contradiction. At first, assume tf is finite. 
Taking Vi(xj) as a sub-Lyapunov function gives 

Vi(xi(f)) < -Wi(xi{t )) - biAf(ki)yi£i < -biAf(ki)ki. (5) 


By integrating both sides from 0 to t , it follows 


Vi(xi(t)) - Vi(xi(0)) < 


and hence 



( 6 ) 


Vi(xi(t )) < bi[ki(t) 2 cos(fcj(f)) - 2ki(t) sin(ki(t)) -2 cos(fcj(t))] +C (7) 

where C = Vi(xi(0)) — bi[ki(f)) 2 cos(fcj(0)) — 2ki(0) sin(/ci(0)) — 2cos(fcj(0))] is a finite consonant. 
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We will prove the boundedness of all trajectories to get a contradiction. To prove this, we now 
seek another contradiction. Without loss of generality, suppose k t (t) is upper unbounded. From the 
continuousness of hft), we can choose a monotonic increasing sequence t l n such that 


(2 n + l)7r, if bi > 0, 
2nir, if bi < 0. 


Clearly, for any i, lim„_,. +0O t l n = tf. 
By direct calculations, one has 


Vitxiiti)) < 


bi[—(2n + l) 2 7r 2 + 2] + C, if 6, > 0, 
bi{An 2 Tt 2 — 2] + C, if bi < 0. 


( 8 ) 


From this, we can deduce that Vi{xi(t l n )) < 0 for a large enough n, which contradicts the positive 
semidefiniteness of Vi(xi). Therefore, ki(t ) is bounded during [0, tf) for each i. From ® and 0), 
Ui(t) and Xi(t), kilt ) are also bounded during [0, tf) for each i. This implies with a contradiction 
argument that no finite-time escape phenomenon happens and tf = oo. 

Step 2: In this step, we will show that yt — j/y —0 (i —>• oo) for any i, j = 1 ,N. Let K(t) = 
J2iLi h{t), then 

N N 

K{t) = ^2 *i( 4 ) = + Vi 

»=1 i=1 

which is bounded from the boundedness of yi(t), £i{t) and Xi(t). As a result, K{t) is uniformly continuous 
with respect to time t during [0, oo). 

Also, note that 

N 

K(t) dt = Y^Moo) - k z (0)] < K* (9) 

i=l 

where K* is a finite constant determined by the bound of fc t (f) (i = 1,... ,N). That is, K(t) is integrable 
on [0, oo). By Barbalat’s Lemma, we can derive 

N 

lim K(t) = lim V kAt) = lim y T Ly = 0 

t-s-oo v ' t-> oo^ v ' t-> oo y y 

i= 1 

where y = col(j/i,..., j/jv) and L is the Laplacian of the undirected graph. From its connectivity assump¬ 
tion and by Proposition 3.8 in |l3^ , y —> spanll^r}, which completes the proof. I 



In the control law multiple Nussbaum gains are employed to tackle the problem of unknown het¬ 
erogeneous high-frequency-gain signs. Although we have chosen k 2 sin(fc) as the Nussbaum-type function, 
it can be verified that, other Nussbaum-type functions such as k 2 cos (k) and e k cos (k) can be employed 
in Step 1 as well to achieve the leaderless output consensus among this multi-agent system. 

Remark 3 A similar problem was considered in f|]/ for pure integrators with unknown control directions. 
However, those results heavily relied on the assumption that all agents have the same control direction. 
Here by constructing sub-Lyapunov functions mentioned above, the control design and analysis for this 
group of interacting systems are significantly simplified. 
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Remark 4 This result provides a sufficient condition to the consensus problem among a general class 


of agents with heterogeneous control directions, which strictly includes the single integrator in 0/ as a 
special case. Also, since we only assumed those agents having a passivity-like property, this approach may 
considerably enlarge the applications of passivity as a design tool (ft) in multi-agent systems. Moreover, 
when all agents are homogenous and share an incremental observability property (lu])> they will eventually 
achieve state consensus under this control law, which can be taken as an extension to the results in ft] 
for networked nonlinear agents with unknown control directions. 


Unfolding the control law in Q, we may extend this conclusion to a general class of digraphs as follows. 

Corollary 1 Consider the multi-agent system consisting of N agents given by ©, there exists a dis¬ 
tributed adaptive controller of the form 

V'i ki yi£,i (10) 

where £* = a ij(Vi ~ Uj ) an d Af(ki) = kf sin (ki), such that the output consensus of this multi-agent 

system is achieved when the communication digraph is balanced and weakly connected. 

Proof: By similar arguments as in Theorem [TJ we can derive that ki, Xi, £ i , Xi, and are bounded and 
K(t) = ki{t) is uniformly continuous with respect to time t and integrable on [0, oo). Hence, 

N ■ 1 

lim K{t) = lim ki(t) = - lim y T (L + L T )y = 0. 

t—too t—too * ^ 2 t—^oo 

2—1 

Since a weakly connected balanced digraph is automatically strongly connected, and hence it contains a 
rooted out-branching. By Theorem 3.12 in (3], the corresponding protocol can achieve output consensus 
of these agents. I 


Without additional conditions, the controller in Theorem Q] can only ensure the output consensus, 
i. e., yi —> yj ( t —» oo) for i,j. In some problems, we may also need to drive all yi to some desired 
value, such as the equilibrium. It is remarkable that this may happen automatically in some special cases 
after applying Barbalat’s Lemma and then deliberately checking its asymptotical property of this multi¬ 
agent system as a whole one. To guarantee this property, we can employ a leader-following formulation 
and propose a distributed control law, where the reference is described by a leader. Unlike in the 
centralized/decentralized cases when each agent knows this value, only a few agents are assumed to know 
it in our cases to save the communication resources. With some modifications on the protocol dD, a 
Nussbaum-type adaptive controller will be designed for each agent in the network to realize this goal. 

To keep consistence, we assume as usual the reference point is generated by a leader (denoted as 0) 

%o = 0, y 0 = x 0 - (11) 

With the help of graph notations, the information flow between the leader and those other agents can be 
defined as well. 

The following theorem shows how this problem can be solved for those nonlinear heterogeneous multi¬ 
agent systems without knowing the control directions. 

Theorem 2 Consider the multi-agent system consisting of N followers given by m and a leader (HD 
with £ 0 ( 0 ) = 0, there exists a distributed controller of the form 

V'i — M(ki)ii, ki — (1^) 
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where & = J/j)+ a io(2/i — Ho) andN(ki) = kf sin(fcj), suc/i i/iai </ie consensus problem of this 

multi-agent system can be solved when the induced subgraph of those followers are undirected, strongly 
connected and the leader is globally reachable from any other agent. 

Proof: The proof is similar with that of Theorem [1] Following those procedures, we can first prove the 
boundedness of Xi(t), £i(t), Xi, and ki(t), and hence the uniform continuous of K(t ) = hi(t) with 

respect to the time t. By Barbalat’s Lemma, one can obtain 

lim K(t) = — lim e T (H + H T )e = 0 

t—fOO 2 t—fOO 

where e = col(j/i — yo ,..., yN — yo) = y T , and H is the submatrix by removing its first row and column of 
the Laplacian corresponding to the N + 1 networked agent systems. By Lemma 3 in Q, e will eventually 
vanish. Thus the proof is completed. I 


This result still holds for a class of digraphs as follows. 

Corollary 2 Consider the multi-agent system consisting of N followers given by 0 and one leader (HD 
with xo( 0 ) = 0 , there exists a distributed controller of the form 


Ui = -A/"(&»)&, hi = yi& (13) 

where £; = aj j(yi — yj ) + aio(yi — yo). an d Af(ki) = kf sin(fcj), such that the consensus problem of 

this multi-agent system can be solved when the induced subgraph of those followers are balanced, weakly 
connected and the leader is globally reachable from any other agent. 


The proof is similar with that of Theorem [U and thus omitted. 


Remark 5 While only leaderless consensus was investigated in \2], we provided sufficient conditions to 


achieve leader-following consensus. The results in By are its special cases when all considered agents 
are single integrators. Moreover, if all agents are constant incremental passive nlU]). it can be extended 
to the non-equilibrium cases. When no agent has an unknown control direction, these leader-following 
consensus results are consistent with that in fl 8 1. 


5 Simulations 

In this section, we proposed several examples to verify the distributed designs in Section 4. 

First, consider a group of controlled oscillators with heterogeneous control directions as follows. 



Their interconnection topology is depicted in Figure 0a) as an undirected graph, which satisfies the 
assumptions in Theorem [U Since b\, 62 . ^4 are unknown and may not have the identical sign, the 

control laws in { 2 , 231 are not applicable. While it can be verified all these systems share the passivity-like 


property, we applied the controller (0) and its performance is depicted in Figure [2] 
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(a) The graph Q\ (b) The graph Q 2 


Figure 1: The communication graphs. 

To make it more interesting, we now consider four heterogeneous agents, including a single integrator 
±1 = 0, yi = X\ as the leader, two oscillators and a controlled Lorenz system as the followers. 


X21 = X22 X31 = £32 

X22 = -X22 + b 2 u 2 S X 32 = -X 31 - X32 + b 3 u 3 < 

V2 = X 2 2, I 2/3 =£32, 


X41 = X42 — X41 

X42 = X41 — X42 — X41X43 + 64M4 
X43 = X41X42 — X43 
2/4 = x 42 . 


Their interconnection topology is depicted in Figure[]Jb) by removing the edge pointed to agent 1, which 
satisfies the assumptions in Theorem [5] The simulations result under the controller (fl2l) is presented in 
Figure [3] 



Figure 2: Output trajectories of agents under control law (0. 


6 Conclusions 

An output consensus problem was solved for a general class of nonlinear heterogeneous systems without 
a prior knowledge of the agents’ control directions. Both the leader less and leader-following consensus 
were achieved with the help of two distributed Nussbaum-type control laws. Further work will include 
the extensions for more general systems and graphs with possible disturbances. 
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Figure 3: Output trajectories of agents under control law m- 
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